On the variances of a spatial unit root model 
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Abstract 

Asymptotic properties of the variances of the spatial autoregressive model £ = 
aXfc_i £+/3Xfc £_i+7Xfc_i^£_i+efc £ are investigated in the unit root case, that is when 
the parameters are on the boundary of the domain of stability that forms a tetrahedron 



m 



-1,11 



The limit of the variance of n 



ns\ , \n£\ 



is determined, where on the 



interior of the faces of the domain of stability q = 1/4, on the edges q = 1/2, while 
on the vertices q = \. 

Key words: Spatial autoregressive processes, unit root models. 



1 Introduction 

The analysis of spatial autoregressive models is of interest in many different fields of science 
such as geograp hy, geology, biology and agriculture. A detailed discussion of these applica- 
tions is given by iBasu and Reinsell (119931 ) where the authors considered a special case of the 
so called unilateral autoregressive model having the form 



pi P2 



i=0 j=0 



"0,0 = 0. (1.1) 
A particular case of the above model is the doubly geometric spatial autoregressive process 



aX, 



11-1 



introduced by iMartinI (119791 ). This was the first spatial autoregressive model for which 
unstability has been studied. It is, in fact, the simplest spatial model, since the product 
structure (p{x,y) = xy—ax—Py+aP = {x—a){y—P) of its characteristic polynomial ensures 
that it can be considered as some kind of combination of two autoregressive processes on the 
line, and several properties can be derive d by t h e ana logy of one-dimensional autoregressive 
processes. This model has been used by IJainI (Il98ll ) in the study of image processing, by 
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Martini (11990 ') . ICuUis and GleesonI ( Il99ll ). iBasu and Reinsell ( Il994j ) in agricultural trials and 
by lTj0stlieinj ( 119811 ) in digital filtering. 

In the stable case when |q;| < 1 and < 1, asymptotic normality of several estimators 
/3m,n) of ( q, (3) based on the obs erv ations jXk/ : 1 < k < m and 1 < £ < n} has 



been shown (e.g. 



TieistheinJ Jl978[ Il983l ) or iBasu and Reinsell Jl992[ \l99^ ). namely, 



mn 



, Pm.n /3 



as m, n — )■ oo with m/n — )■ constant > with some covariance matrix Sa,/3. 

In the unstable case when a = P = 1, in contrast to the classical first order autore- 
gressive time series model, where the appropriately normed least squares estimator (LSE) 



Phillips 


( 


1987 


) or 



nian motion (see e.g. 

Newton estimators (a„,.ni n.n) of (a, /3) has been shown to be asymptotically normal (see 
Bhattacharyya et all (Il996[ ) and iBhattacharyya et al\ (Il997l )). In the unstable case a = 1, 



< 1 the LSE turns out to be asymptotically normal again (IBhattacharyya et all 119961 ) 



Baran et al\ (12004 ) discussed a special case of the model ( II. ip . namely, when pi = P2 = 1, 
«o,i = «i,o =• C( and ai i = 0, which is the simplest spatial model, that can not be reduced 
som ehow to a utore g ressive r nodel s on the line. This model is stable in case |a| < 1/2 (see 
e.g. 
In 



Whittlel ( 



Baran et al. 



BesagI ( I1972I ) or iBasu and Reinsell (Il993l )). and unstable if 



1/2. 

(l2004f ) the asymptotic normality of the LSE of the unknown parameter a is 
proved both in stable an d unstable cases. T he case_2j_^_22_= L ai,o ='■ (^1 o^o,i ='■ P and 



= was studied by iPaulauskasI ( 120071 ) and iBaran et al\ (120071). This rn o del is stable 
in case |a| + < 1 and unstable if |a| + = 1 (IBasu and Reinsell . Il993l ). iPaulauskas 



(l2007l) deter r nined the exact asymptotic behaviour of the variances of the process, while 
Baran et al\ ( 120071 ) proved the asymptotic normality of the LSE of the parameters both in 
stable and unstable cases. 

In the present paper we study the asymptotic properties of a more complicated special 
case of the model (II. ip with pi = P2 = 1, ^1,0 =: ^0,1 =: P and ai^i =: 7. Our 
aim is to clarify the asymptotic behaviour of the variances. The asymptotic results on the 
variances (and covariances) help in findin g the asymp t otic propert ies of various estimators 
of the autoregressive parameters (see e.g. iBaran et al\ ( 120041 . 120071 )). 

We consider the spatial autoregressive process {X^ ^ : k, i E Z, k, i > 0} is defined as 



Xk,e = aXk-i,t + PXk/-! + 7Xfc_i,£_i + ek,i, for A;, £ > 1, 
X.o = Xo. = 0, for kJ>Q. 



:i.2) 



The model is stable if |a| < 1, < 1 and I7I < 1, |1 + - (3'^ - 7^| > 2|q; + I3^\ and 
1-/9^ > |a+/37|, and unstable on the boundary of this domain (IBasu and Reinsell . Il993l ) (see 
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Figure 1: The domain of stability of model (11. 2p . 

Figure [T]). Short calculation shows that condition of stability means that |a| < 1, < 1 
and I7I < 1, and inequalities 

a-/3-7<l, -a; + /3-7<l, -«-/3 + 7<l, a + /3 + 7<l 

hold. Obviously, in case a/37 > the above set of conditions reduces to |a| + |/3| + |7|<l. 
If the model is not stable, one can distinguish three cases: 

Case A. The parameters are in the interior of the faces of the boundary of the domain of 
stability, i.e. \a\ < 1, \(3\ < 1, I7I < 1 and one of the following equations is fulfilled 

a-/3-7 = l; -a + /3-7 = l; -a - (3 + = 1; a + /3 + 7 = l. (1.3) 

We remark that in case a/37 > the set of equations (II. 3p is equivalent to |a| + |/3| + |7| = l, 
while in case a/37 < to 

l"l + - I7I = 1 or |a| - |/3| + I7I = 1 or - |a| + |/3| + I7I = 1. 

Case B. The parameters are in the interior of the edges of the boundary of the domain of 
stability, i.e. a(3j < and one of the following equations is fulfilled 

|a| = 1 and |/3| = I7I < 1; |/3| = 1 and |a| = I7I < 1; I7I = 1 and |a| = |/3| < 1. 
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Observe that in each of the above three cases exactly two of the defining equations (11. 3p of 
Case A are satisfied. In this way Case B can be considered as an extension of Case A to 
the situation when a/37 < and one of the parameters equals ±1, while the other two 
parameters have absolute values less than one. 

Further, observe that in the first two cases 7 = —a/3, so we obtain spacial cases of the 
doubly geometric model. If |a| = 1, |/3| = I7I < 1 then for A; G N the difference 
Ai^aXk/ := Xk,e - aXk-i/ is a classical AR(1) process, i.e. Ai^qX^,^ = fi/^i^^Xu/-! + ek,i- 
Similarly, if |/3| = 1, |a| = I7I < 1 then /\2,pXk/ = a/\2,pXk^i^i> + Sk/, where /\2,i3Xk/: = 
Xk,, - /3X,,,_i, £ G N. 

Case C. The parameters are in the vertices of the boundary of the domain of stability, i.e. 
a/37 = ~1 ^iid |a| = |/3| = I7I = 1. 

Theorem 1.1 Let {sk/ : G N} he independent random variables with ^ek,i = and 
NdJEk/ = 1- Assume that model f 1 1.2 1) holds and for n G N consider the piecewise constant 
random field 

y(")(s,t) :=X[„,],[,t], s,tGR, s,t>0. 

If |a| < 1, |/3| < 1 and I7I < 1, |1 + a^ - /32 - 7^1 > 2|a + /37I and 1 - (3'^ > \a + l3-f\ 
then 



lim Var(y(")(s,t)) = al^^^ := ((l + a+/3-7)(l + a-/3+7)(l-a+/3+7)(l-a-/3-7))" 



-1/2 



// |a| < 1, |/3| < 1 and I7I < 1 and in case a/37 > equation |a| + |/3| + I7I = 1, while 
in case a/37 < equation \a\ + \(3\ — I7I = 1 holds then 



„^oonV2 V V 7rV2(|a| + |/3|)i/2(i _ |a|)(l 

If a/37 < and \a\ = 1, |/3| = I7I < 1 or |/3| = 1, |a| = I7I < 1 t/ien 

lim -Var(r("Vs,t)) = or lim -VarfF^^Vs, t)) = - 

n— s>oo 72 ^ ^ 1 — 72 n— >-oo n 1 



2 ' 



7^ n— >-oo ^ 1 — 7 

// a/37 = ~1 ^'^^ |a| = |/3| = I7I = 1 then 

lim 4var(F(''Vs,t)) = st. 

n->-oo n 



Observe that in the last case the limit of the variances is exactly the variance of the 
standard Wiener sheet. This result is quite natural, as e.g. for a = /3 = —7 = 1 model 
equation (11.21) reduces to Ai iA2,iX,fc £ = Sk/- 
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We remark that results given Theorem 11.11 do not cover all possible locations of the 
parameters on the boundary of the domain of stability. Some results on the missing cases 
can be found in Section HI 

The aim of the following discussion is to show that it suffices to prove Theorem 11.11 for 
a > 0, /3 > and 7 > if a/37 > and for a > 0, /3 > and 7 < if a/37 < 0. 
First we note that direct calculations imply 



k e 



Xk/ = X] G{k j; a, /3, 7)6^^ 

i=i j=i 

k I 



EE 

i=i j=i 



k+i-i-j 



a 



ap 



(1.4) 

:i.5) 



k,i > 1, where (II. 5p holds only for a/3 7^ 

mAn 



G{m, n- a, /3, 7) := ''1' ,,. «"^"'^"'7^ m, n G N U {0}, 



r=0 



(m — r)!(n — r)!r! 



and F{—n, b; c; z) is the Gauss hypergeometric function defined by 

F(-r^,6;c;^):=V^4^M5^^^ neN, b,c,zeC, 



r=0 



{c)rr\ 



and (g),. := a(a + 1 ) . . . ( a + r — 1) (for the definition in more general cases see e.g. 



Bateman and Erdelyil (119531 )). 



Observe that as for m,n E N we have F{—n,—m;—n — m; 1) = ('"^") 



-1 



and 

F j—n, —m ; —n — m; 0) = 1, moving average representa tions of the doubly geo metric model 



of iMartinI (|l979l) and of the spatial models studied by iPaulauskad (120071 ) and iBaran et al. 
(I2OO4I . |2007| ). respectively, are special forms of (11.51) . 

Now, put Sk/ := {—l)^'^'''ek,t for G N. Then {sk/ : A;,£ G N} are independent 
random variables with Esk/ = and Yaiek/ = 1. Consider the process {Xk/ : k,i E 
Z, k,i> 0} defined as 

Xk/ = -aXk^i/ - (3Xk/-i + lXk-i/-i + Sk/, for fc, ^ > 1, 
^M = ^o,£ = 0, for A;,£>0. 

Then by representation (II. 4p for A;, £ G N we have 



k i 



Xk/ = X] G{k - i, £ - j; -a, -/3, 7)5^ 
i=\ i=i 

k I 

= E Y.^-l)'^'~'~'G{k - z, £ - j; a, /3, 7)5,, = {-l)'^'Xk/, 
i=i j=i 
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hence VarXk/ = VarX^/. 

Next, put ek/:= {-l)^ek,i for kjen. Then {ek/:k,ieN} are again independent 
random variables with Ee'k/ = and VenEk/ = 1. Consider the process {Xk/ : k,i & 
Z, k,i> 0} defined as 

Xk,e = -aXk-i/ + PXk/-i - lXk-i/-i + Sk/, for fc, £ > 1, 
.^M = ^o,£ = 0, for A;,£>0. 

Then by representation (ll.4p for fc, £ G N we have 

k I 

Xk,e = X] 5Z -iJ- j; -a, 

i=i j=i 

k I 

= Yl - z, £ - j; a, /3, 7)e„- = {-l)'Xk,e, 

1=1 j=i 

hence VarX^^^ = VarX^^^. 

In a similar way we have Xk,e = (— l)^-^fc/, so VenXk/ = VarX^^^, where {Xk,e ■ k,i E 
Z, k,£ > 0} is defined as 

Xk/ = aXk-i/ - (3Xk/-i - 'jXk~i,e-i + ^k/, for k,i>l, 
Xka = Xo,e = l. for k,e>0, 



with ek,e := {-lYek/. 



2 Upper bounds for the covariances 

By representations (11.41) and fll.Sp we obtain that for ki, ii, k2, ^2 and a, /3, 7 G M we 
have 

kiAk2 

Cov(Xfc^,£^,Xfc2,^J=^ Y^G{kx -iAi - j;a,/3,7)G(fc2 -«,^2 -j;a,l3,-f) (2.1) 
i=i j=i 



\ ap J \ ap 

where x Ay := min{x, y}, x,y eM, and (12.21) holds only for af3 7^ 0. 

To obtain a more convenient form of the covariances we prove the following Lemma. 
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Lemma 2.1 Let n^m he nonnegative integers and let q;,/3,7 G M such that < < 1 

and q;/3 + 7>0. Then 

where C,n^ and r]m\ < /i, z/ < 1, are independent binomial random variables with 

parameters (n, z/) and {m,fi), respectively, if m,n & N, and ^J'^^ = ryj'^) := 0. 

Proof As in cases a(3'y = or a/3 + 7 = the statement of the Lemma holds trivially, 
we may assume a/37 a/3 + 7 > 0. Let < n < m. 



T- = 



(m — r)!(r?, — r)!r! n! 



^(n + m-r)!^ "^-P ^^^W - „ _ .A - (/^ + l7l)"( sign(7))"^ d"(a-d^)(a,)) 



n 



r_o — ^ " ^ ^! da;^ 



where z/ := a^, , , a^ := sign(7) a and Qn\x) := {i'x+{l~v))^ is the generating function 



/3+I7I 

of . From the other hand 



7 r=0 

and as a/3 + 7 < a + 7 we obtain 
G(m, n; a, /3, 7) = (^'^ ^) + 7)"-^a'"-"+'- (2.3) 



r-=0 

Moreover 



- ) 



r=0 \ / ^ / r=m-n V / V 

^ ^ r=m— n ^ 



a"(a/3 + 7)"-''/3"- 



-m+r 



that together with (12 .Sp implies the statement of the lemma. Case n > m can be handled 
in a similar way. □ 
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Corollary 2.2 // < a, /3 < 1 and a + /3 + 7 = 1 then 

G(m, n; a, /3, 7) = P (^"^ + ^i'"^^ = m) = P (^f ) + //(J"") = . 



The following lemma is a natural generalization of Theorem 2.4 of iBaran et al\ (120071 ). 



Lemma 2.3 Lei A;,£ G N, let < u < 1 be real numbers and let and rj^^^'' 

be independent binomial random variables with parameters {k,v) and (i,^), respectively. 
Further, let Sk/ ^k"^ + lif^ and let 



k,li 



VaiS, 



X 



Then for all fc, £ G N and j G {0, 1, . . . , A; + £}, we have 



P(^M = i)- 



27r6, 



= exp {-xli^^j2) 

•kl 



< 



Jkl 



where C(/i, z/) > is a constant depending only on /i and v (and not depending on 

Theorem 2.4 // |a| + + I7I < 1 then 

{\a\ + \P\ + \^\Y\ki-k2\+\ii-i2\)/2 



Cov(Xfc^^£^, Xfc^.^a) — 



(l-(|a| + |/3| + |7|))' 



// \a\ < 1, \f3\ < 1 and I7I < 1 and in case af3j > equation \a\ + \(3\ + I7I = 1, 
while in case aP'~f < equation \a\ + — I7I = 1 holds then 

\Cov{Xk,,e„Xk,,e,)\< C{a, l3)^/h + i, + h + £2 
with some constant C(a,/3) > 0. 

If a/37 < and \a\ = 1, = I7I < 1 or = 1, |a| = I7I < 1 then 

Cov(Xfc,,,,,Xfc,,,J < (A;iAA;2)^ ^ or Cov(Xfc,,,,, X^,,,,) < (£1 A £2)- 

I I X — 7"^ ' ' 

respectively. 

If a/37 = —1 and \a\ = \f3\ = I7I = 1 then 



1-72 



Proof. Let |a| + |/3| + I7I < 1. Lemma [O and ([2J]) imply 



i=l 0=1 ^ 

^ . |a| + 



1-1/91 



|fcl-fc2|/2 



(fci+fc2)/2-i 



/3| + |7 
1 — \a\ 



{l^+ii)l2~i 



l/3| + l7l 
1 — \q\ 

(l-(|a| + |/3| + |7|))^ 
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Hence, as 



hold, we obtain the first statement of the theorem. 

Now, let \a\ < 1, \(3\ < 1, I7I < 1 and assume that in case a/37 ^ equation 
I'^l + 1/^1 + I7I = while in case a/37 < equation |a| + |/3| — I7I = 1 holds. From 
the arguments of the Introduction follows that it suffices to consider the case < a, /3 < 
1, I7I < 1, and a + /3 + 7 = 1. Corollary O and imply 

Assume first ki < ^2 and ii < £2 or ki > k2 and £1 > £2- In this case using the 
notations and results of Lemma 12.31 we have 

A:iAfc2-l £iA^2-l 



|Cov(X,,,„X,,,J| <J2I1 P{^\:U\~.^+vt-lM = \k^-k2\+^)p{^t^+v^ 



i=0 j=0 



fciAfc2-l^iA£2-l ^2 
^ ^ ^ i _gXp'^ |fcl-fc2|+«,|fcl-fc2|+j,|^l-£2|+j -^1,1^ 



i=2 j=2 '^'^V^\i'i-i'2\+^h-e2\+j\/Kj V 2 2 

kiAk2-l ^ ^iA^2-l ^ kiAk2-l eiAi2-l 

+ c{a,p){ E h E 7+ E E 'y'V*' 

1=2 j=2 j=2 j=2 

where C (a, /3) is a positive constant and 

:= a(l-a)A;+/3(l-/3)£ and Xk,k/ ■= aki/ ^/h} with a^,^ := (l-a)A;-(l-/3)£. 
Obviously, 



^ - < 2v/^rAA^< 2xArT^ and ^ - < 2^^! Afs < 2^4 + 

i=2 ^ i=2 

Further, we have 

fclAfc2-l ^lAfe-l fciAfc2-l £lA£2-l 

E E "5''= E E (a(l-a.). + W-/3br"^ 

i=2 j=2 1=2 j=2 

fciAA:2-l^i'^^2-l feiAfc2-l 

< / (a(l - a)^ + /3(1 - /3)t)-'/^dt < — -- ^ " 

1=2-1 P\ P) 



4/2 



fci Afe2 — 1 ^ , , \ 1/2 



2 f , , . ^-ll2 4(a(l-a)) , 



10 



Baran 



Hence, 

|Cov(Xfc,,,,,Xfc„,j| < C{a, 13) ^/h + ii + k2 + e2 + AH^Aki, 4, h, ^2), (2.4) 

with 




1 1 



'^TT\/b\ki-k2\+s,\ii-e2\+t^/bI^t 



exp 



2 2 / 

It is easy to see that 

HaAklJuk2,i2) < ^ 



Idtds. 



(a + /3)(l-a)(l-/3) 



X 

61,1 <ll,f]^Af2 



1 



27rA/(&|fci-fc2|,Kl-<?2| + V 2(6|fei_fe2|, 1^1-^21 

2 

Now, for some real constants a < b and g, we have 
b 



exp — 



v'^\ ^J■K{q + u)u ( 

— df = , exp 
1u) J2(q^2u) V 



2(g + M) 2m; ^2(g + 2m) V 2(g + 2u), 

(g + 2-u)a + 



, Vv/2(g + 2M) (« + «)«/ V 



v/2(g + 2M)(g + M)M/ W2(g + 2M)(g + m)m 

where $(x) := 2^{^2x) — 1, x G M, is the Gauss error function defined with the help of 
the cdf $(x) of the standard normal distribution. Hence 

HaAkiJi,k2,i2) < 



27r(a + /3)(l-a)(l-/3) 

bki/\k2,li/\l2 



^ expf- <-^^M^^-^^l )dn 



A/&|fci-fe2|,Ki-<?2|+2^i V 2(6|fej_fe2|,Ki-^2| + 2^^) 
61,1 



Ofe]^ Afe2,fi A«2 



<^ / dw 

V2^(a + /3)(1 -a)(l -/3) 7 Vhk,-k2\,\e,-i2\ + 2m 

^ v/2a(l - a)(fci + fc2) + 2/3(1 - /3)(£i + £2) ^ Vh+T^TK+h 



y^ia + /3)(1 - a)(l - /3) - v^(a + /3)(1 - a)(l - /3) 

that together with fl2.4l) implies the second statement of the theorem. Cases ki < k2, ii > £2 
and ki > k2, ^1 < ^2 can be handled in a similar way. 
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Further, let a/37 < and |a| = 1, \(3\ = I7I < 1 or \f3\ = 1, |a| = I7I < 1. In 
this case — 7/(a;/3) = 1. As for n,m E N one has F{—n, — m; —n — m; 1) = (™^") , 
representation fl2.2p implies 

Cov(X,,,,„Xfc,,,J =J2Y1 «'=^+'=-2.^£.+.2-2,- (2.5) 

i=i j=i 

Obviously, (12. 5 p also holds if |a| = 1, /3 = 7 = or = 1, a = 7 = 0. Hence, e.g. if 

|a| = l, |/3| = |7|<1 

|Cov(Xfc,,,„Xfc„,j| < (fciAfcs)^^ |7|^^+^^-2, < (fc^AA;2)|7|l'^-'^l J^t'^' < (^lA^a)^^- 

j=l j=0 ^ 

Finally, if a/37 = —1 and |a| = |/3| = I7I = 1 then — 7/(a/3) = 1, so 

fclAfc2 ^lA£2 

Cov(Xfc„,„Xfc,,,J= J2 $^«'^"''^/3'^+'^ = (A:iAA;2)(£iA4)al'^~'^l/3l'^-'^l (2.6) 
that completes the proof. □ 



3 Proof of Theorem 11.1 



According to the results of the Introduction we may assume a > 0, /3 > and 7 > if 
a/?7 > and a > 0, /3 > and 7 < 0, otherwise. 

Let 0<a,/3<l and I7I < 1, |1 + a^ - /32 - 7^1 > 2|a + /37I and 1 - jS'^ > \a + l3-f\. 
Representation (12. ip directly implies 

Jim Var(F(")(s,t)) =5^5^(G(^,j;a,/3,7)) . (3.1) 

To show that the right hand side of (13. ip equals o"^^/?^^ consider the stationary solution X^^^ 
of the equation 

where {e^^ : G Z} are independent random variables with Ee^^ = and Vare:^^ = 
1. As the model i s stable, Xt j, h as the following L^-convergent infinite moving average 



representation (see iTjetstheiml (119781 . Lemma 5.1)) 



i=0 j=0 
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Hence, 

oo oo 2 

Var(X,*,,) =^^(G(2,j;a,/3,7)) • 



i=0 j=0 



On the other hand, using the results of iBasu and Reinsell (119931 ) one can easily show that 
Var(Xfe,^) = al^^^. 

Further, let <a,/3 < 1, I7I < 1, and a + /3 + 7 = 1. Corollary O and imply 



[ns]~l [nt]-l 



Var(FW(.,t))= Y: E P\&'''+Vt'' = k). 



k=0 i=0 



Hence, to find the limit on n ^/^Var t)) as n — )■ 00, one can use the local version 

of the central limit theorem given in Lemma 12.31 that yields approximation 

[ns]-l [nt]-l 

Var(FW(.,t)) := E E TTZJ- { ' 4,k,e) 



2'Kbk f 
k=i 1=1 '^'^ 

[ns] [nt\ 

1 




1 1 



Direct calculations show that for the error 

AS(.,t) :=Var(r(")(.,t))-ES(.,t) 
of the approximation we have 

f[ns]-l[nt]-l [ns]~l[nt]-l / ™2 x 



(3.2) 



where C(a,/3) is a positive constant. Now, similarly to the proof of Theorem 12.41 one can 
verify that 

[n^l[n^l^ ^ ^ ln([ns]) 

^^62,- a/3(l-«)(l-/3) - a(3{l-a){l-(3y 

Further, 

Eg^e.p(--f),4//J^e.p(-^^)d.d. ,3.4, 



k=2 i=2 '^k/ ^ 11 



^[ns],[nt] "-[ns].! 

4 



(a + /3)(l-a)(l-/3) 7 7 
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Again, for some real constants a < b and m > 

J \ mu J 2 \ \ yjmu J 



a \ 



/mu ) 



(3.5) 



holds, so using (13 .4^ and (13. 5 p with m = 2 we have 

'ns\-\\nt\-\ ^ f 

6FF'''H~~2 ; ^ (a+/3)(l-«)(l-/3)"A 



2^ Z^ 737^exp(-^) <y-^^^y^— ^y^-^ln 



k=2 i=2 "k,e 

that together with (13. 2p and (13. 3 p implies 



n->-oo 77, 



Hence, n-^/^Var (r(")(s, t)) and n-^/^E^^]^{s,t) have the same limit as ra — )■ oo. 
Now, let 



where 



[ns] [nt] 



t)-= j J exp ( - xly^,)dzdy 

1 1 ^'^ 



Obviously, 



A^:iis,t) = A^:;^'\s,t)+A^:fis,t), (3.6) 



where 



[ns] [nt] 2 

1 1 

[ns] [nt] 



1 1 

As |z — [z] I < 1, 2; G M, and for 2; > we have 2;exp(— 2;) < 1, and |1 — exp(— z)| < |z|, 
while for -z > 1, [z] > z/2 holds, after short straightforward calculations (see also (13. 3p ) 
we obtain 

[ns] [nt] 

1 1 ^' 
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Further, using similar ideas as in the proof of (13 .yp we have 

[ns] [nt] , r, r, , r, r, [nt] 

(^'.*)| %y / ^, exp( )i,iy<-J J d.dy 

11 11 



TT 



1 1 



[ns] [nt] [ns] [nt] 

A r r I , , 2 r r i 



[ns] [nt] 

8\n([ns] + 1) 2 f f 1 

7ra/3(l - a)(l - /3) vr J J " ' '6y,^|ay,^| 



1 1 



b[ns],[nt] 1[ns],l 

81n([ns] + 1) 2 [ [ y ^ A 

-7ra/3(l - a)(l - /3) + 7r(a + /3)(1 - a){l - /3) 7 n 7 -^{H^i}^^^ 

^ 81n([ns] + l) 41n([ns] + [nt]) / [ns] + [nt] 

where Xh denotes the indicator function of a set if, that together with f l3.6p and (13. 7p 
imphes 



1 

n— ^oo 77, 



Hence, n-^/2Var(y(")(s, t)) and n'^/^^J^j^s, t) have the same hmit as n — )■ oo. 

Now, consider first the case a(l — a)s < /3(1 — implying q:(1 — Q;)[ns] + /3(1 — /3) < 
«(! — q;) + /3(1 — /3)[nt], if n is large enough. In this case 



where 



-M//3+(a+/3)(l-a)//3 
fci,[nt] -M//3+(Q+/3)(l-Q)[n.s]//3 

''[nsl.l -M//3+("+/3)(l-a)//3 
fe[ns],[nt] -V/9+(o+/3)(l-a)M//3 

''l,[ntl u/a~{a.+l3)(l-l3)[nt]/a 
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Using fl3.5p with m = 1, as $(— x) = — $(a;), we have 



0[ns],l 



bi,i 



2v^ 



a 



wa 



13 ^13 



/3 



,(n,2). 1 



20F 



/3 



/3 wP 



1 



•\/^[nsi"^[nt]' 



/3 



\ a 



wa 



Combining similar terms we obtain 

1 



where 



{F^:l\s. t)+FS'\s, t)+F^y\s, t)+F^y\s, t)) , (S.S) 



<n,2) 



2v^(a + /3)(l-a)(l-/3) 



/3 



Let 



•^^[ns],l 



Short calculation shows that 



n 



1/2 



a,l3 



< / id. < 1 1„ f M±i 1 ^ (3.9) 



16 



Baran 



as n — 7- oo. Further, for a < b we have 

b 



/ * ) = ( " ^ ( ^ 5) ) + "* (^) " "* (^) • 



so 

.1/2 . /,l/2 



that together with fl3.9p imphes 



Similarly, 



To determine the limit of n ^^'^F'^p\s,t) assume first that {1 — P)t < {l — a)s implying 
(1 — /3)[nt] < (1 — a)[ns] if n is large enough. On the one hand we have 



1 



as — )■ oo. On the other hand 



as n — )• oo, so 



hm -—Fi^'fis, t) = - = (a(l - a)s + /3(1 - - (a(l - a)sY^\ (3.12) 

If (1 — /3)t > (1 — a)s we split the domain of integration in Fj^^\s,t) into two parts, 
that is Fiy^ {s,t) = F^:f'^ {s,t) + t) where 
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Again, on the one hand we have 



.(n,3,l) 



n 



1/2 



n 



1 f ~/ V(a+/3)(l-a)[n g 



1/2 



— W 



/3 



dw 



(3.13) 



[ns],l 



n 



/3 



+ 



/3 



exp 



(v/(« + /3)(l-/3)H-v/^)' 



1 ^ ^(a + /3)(l-/3)< 



as n — oo. On the other hand 
1 



^1/2 

as — !■ oo, so 



(n,3,i). ,^ ^ v/(a + /3)(l-/3)H - . 



^,0 



n-j-oo n^' ^ ''^ 



("■,3,1) 



= {{a + I3){1- a)sY^^ - {a{l-a)s) 



,1/2 



(3.14) 



Similarly to fl3.13p one can also show 



n 



1/2 a,/3 



n 



1/2 



W 



\/ (q;+/3)(1 — Q;)[ns 



/3 



dw 



V(a+/3)(l-/3)[ns] 



^ V^- V(« + /3)(l-/3)^ 



and we also have 



;.(n,3,2) 



^1/2 a,/3 

as n — > oo implying 



ns 



n 



^ V^- V(« + /3)(l-/3)^ 



lim 



^(n,3,2). 



(s,t) = [[a + I3){1- a)sY'^ - (a(l - a)s + /3(1 - /3)t) 



1/2 



(3.15) 



n^oo 77,1/2 

Thus, by summing the limits in ( I3.14p and (I3.15P we obtain that for (1 — (3)t > (1 — a)s 
lim -1-F^^f{s,t) = 2((a+/3)(l-a)s)'/'-(a(l-a)s+/3(l-/3)t)'/'-(a(l-a)s)'/'. (3.16) 

Finally, the asymptotic behaviour of n^^/^F^"^^'*(s, t) in some sense a complementary of 
the behaviour of n^'^/'^F'^p\s,t). In the same way as fl3.12p is proved one can show that 
if (1 -/3)t > {l-a)s 

1 



lim 



F'a'fM = {a{l - a)s + f3{l - f3)tf' - (/3(1 - f3)t) 



n— >oo n 



1/2 



,1/2 



(3.17) 
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In case (1 — < (1 — a)s the domain of integration in F'^p\s^t) has to be spht at 
{a + I3){1 - I3)[nt\ to obtain 



Jim = 2((«+/3)(l-/3)t)'/'-(«(l-«)s+/3(l-/3)t)'/'-(/3(l-/3)t)'/'. (3.18) 



Hence, in case a{l — a)s < /3(1 — I3)t equation fl3.8p and hmits f lS.lOp - f l3.12p and fl3.16p 
- (EUD imply 

hm 4^Var(r(")(.,t)) = hm 4^i?l"^(.,t) = ""^'li ,!^,!'^^ L (3.19) 

If q;(1 — a)s > /3(1 — /3)t we have 



with 



^&'^(^''^):=^ J J -e^P( --)dt;d«, 

fei.i -M//3+(a+/3){l-a)/,9 
''[ns],! u/a-(o+/3)(l-/3)/o 

6i,M M/a-("+/3)(l-/3)H/a 
b[nsl,[nt] -«//3+(o+/3)(l-«)M//3 

b[ns],i u/a-{a+l3){l-l3)[nt]/a 

and (13.191) can be proved similarly to the other case. 

Now, if a/37 < and |a| = 1, = I7I < 1 or = 1, |a| = I7I < 1 using (ES]) we 
have 

l.r ^^ Hl-72["*1 s 1 , [nt]l-72M t 



h,lnt] u/a-{a+l3){l-l3)/a 

1 



-exp ( -—\ 
u \ u J 



-Var(FW(.,t)) = i^^-^^-^ or ±Var(FW(.,t)) . . . . 

n n 1—7^ 1 — 7"^ n 1—7^ 1 — 7"^ 

respectively, as n ^ 00. 

At the end, if a = (3 = —7 = 1 the statement directly follows from Theorem 12.41 □ 



4 Remarks on missing cases 

The results of Theorem 11.11 do not cover the cases when |a|<l, |/3|<1, |7|<1, either 
a/37 <0 or a = /3 = is satisfied, and |a| — |/3| + I7I = 1 or — |a| + |/3| + I7I = 1 holds. 
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For I7I < 1 the above conditions yield two subcases of Case A, while for I7I = 1 we have 
a subcase of Case B. 



In the trivial case a = f3 = and I7I = 1 using directly ( II ■2p it is easy to see that 
Var(Xfc^^) = k A i, hence 

lim -Var(F(")(s,t)) =sAt. (4.1) 



n— >oo n 



If a/37 < according to the results of the Introduction it suffices to consider < a, (3 < 1 
and —1 < 7 < and assume a — /3 — 7 = 1 or —a + /3 — 7 = 1. As the first row of (12.31) 
holds for all positive a and /3, 



mAn / \ / 



where 

' ;i + I3){a - 1) < 0, if a - /3 - 7 = 1, 
1 + a){l3 - 1) < 0, if -a + /3 - 7 = 1. 

Hence, using notations of Lemma 12.11 for a — /3 — 7 = 1 we have 



a/3 + 7 



G(m, n; a, /3, 7) = (1 + 2/3)" ^ (-1)^(4") = m - r) P ( r^^^^^ ^ = r ) , (4.2) 



r=0 

while for —a + /3 — 7 = 1 

mAn / / 1+ \ \ 

G(m, n; a, /3, 7) = (1 + 2a)'" ^(-l)T(ei^) = n - r) P ( r/™^ = r (4.3) 

holds. This means that results similar to Corollary 12.21 can not be obtained. Moreover, the 
exponential terms before the sums in (14. 2 p and (14. 3 p do not allow us to use Lemma 12.31 for 
separate approximations of the probabilities behind the sums. 

Finally, in case a = /3<l, 7 = — 1 short calculation shows (ISzegol . Il939[ ) 

G{m, n; a, a, -1) = al™-"lpifA'r""'^(2a^ - 1), 
so using notation cos(^) = 2a^ — 1 we obtain 

Var(y(")(.,t)) = E E (cos(^^/2))^l'^-^l(<f-^l)(cos(0))) , (4.4) 
fe=o e=o 

where Pn°''^\x) is the nth Jacobi polynomial with parameters a and b. Obviously, as 
-Pn°'°'*(— 1) = (— 1)"", in the trivial case a = /3 = (0 = tt) limit ( 14. ip can be obtained from 
(14. 4p . too. However, as in general the second parameter of the Jacobi polynomial in (14. 4p 
equals \k — i\, to find the limit of the appropriately normed variances of F(")(s,t) the 
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classical approximations of the Jacobi polynomials as e.g. Theorem 8.21.8 of ISzegd (Il939l ) 
can not be used. 
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